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filter  test. 
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1.  Introduction 


The  acoustic  emissions  of  ground  vehicles,  helicopters,  and  aircraft  can  be 
passively  detected  without  the  line-of-sight  restrictions  of  radar  and  opti¬ 
cal  systems.  A  wealth  of  information  can  be  extracted  from  acoustic  sen¬ 
sors  including  target  range  and  velocity,  target  direction  and  classification, 
and  the  presence  of  multiple  targets.  When  compared  to  radar  and  optical 
systems,  acoustic  sensors  are  inexpensive.  With  the  proper  environmental 
conditions,  a  high  signal-to-noiSe  ratio  (SNR)  is  obtainable.  The  acoustic 
emissions  of  targets  are  also  difficult  to  disguise.  Attempts  to  reduce  target 
noise  often  result  in  an  imdesirable  loss  in  performance.  These  characteris¬ 
tics  of  acoustic  technology  make  developing  systems  for  monitoring  tar¬ 
gets  within  a  battlefield  using  acoustic  sensors  attractive.  Acoustic  sensing 
will  complement  existing  techniques  used  for  target  acquisition  and  battle¬ 
field  intelligence. 

A  brief  discussion  of  the  sources  of  acoustic  emissions  provides  an  under¬ 
standing  of  the  processing  needed  within  an  acoustic  sensor.  A  general  de¬ 
scription  of  the  feature  data  extracted  from  broad  classes  of  targets  pro¬ 
vides  a  basis  for  differentiating  the  spectra  of  helicopter,  aircraft,  and 
ground  vehicles. 

The  principal  acoustic  sources  of  a  helicopter  are  the  main  and  tail  rotor 
systems,  and  the  engine.  The  fundamental  frequency  and  harmonics  are 
easily  located  upon  observation  of  the  power  spectrum  of  a  helicopter.  The 
main  rotor  is  generally  easier  to  locate  than  the  tail  rotor.  Systems  will  of¬ 
ten  use  the  relationship  between  the  main  rotor  frequency  and  the  tail  ro¬ 
tor  frequency  for  identification.  In  contrast  to  helicopters,  jet  engines  in  air¬ 
craft  lack  characteristic  harmonic  trains.  They  contain  a  broadband  energy 
distribution  with  some  individual  strong  frequency  lines. 

Ground  vehicles  may  have  considerable  harmonic  content.  Their  acoustic 
emissions  contain  a  combination  of  random  and  periodic  components. 
Noise  is  produced  from  the  propulsion  systems  (e.g.  engine,  exhaust), 
tires,  and  tracks.  A  narrowband  analysis  will  show  characteristic  peaks  at 
frequencies  related  to  a  source  such  as  the  cylinder  firing  rate,  engine  fir¬ 
ing  rate,  and  turbine  rotor  blades.  For  cylinder  base  engines,  the  engine  fir¬ 
ing  rate  is  usually  the  most  predominant  line  in  the  spectrum.  Turbine  en¬ 
gines  produce  no  fundamental  firing  rate;  therefore,  the  acoustic  energy  is 
relatively  flat  and  evenly  distributed  across  the  low  frequencies.  Tire  noise 
of  trucks  and  wheeled  vehicles  results  from  the  interaction  between  the 
tires  and  the  road  surface.  This  noise  source  may  be  attributed  to  tire  vibra¬ 
tion,  and  the  entrapment  and  subsequent  release  of  air  from  the  tread 
cavities. 

Some  tracked  vehicles  may  have  a  high-frequency  peak  associated  with 
the  sprocket  and  track  system.  As  the  tank  moves,  the  track  pulls  from  side 
to  side,  causing  the  center  guide  to  scrape  against  the  steel  rim  of  the  road 
wheels.  This  steel-to-steel  scraping  causes  the  center  guide  to  vibrate  at  its 
resonance  frequency. 
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Engine  accessories  such  as  pumps,  fans,  generators,  and  auxiliary  motors 
will  produce  discrete  frequency  components.  Adequate  vehicle  design  in¬ 
formation  is  needed  in  order  to  properly  identify  these  sources;  however, 
accessories  are  not  usually  harmonically  related  to  other  engine  frequency 
lines,  and  accessory  frequency  lines  are  usually  weaker  in  amplitude  and 
higher  in  frequency  than  the  cylinder  firing  rate. 

The  detection  of  acoustic  signals  is  not  without  its  limitations.  Difficulties 
arise  from  the  signature  variabilities  caused  by  variation  in  ground  vehicle 
rpm,  environmental  conditions,  and  reduced  propagation  distances  associ¬ 
ated  with  a  source  close  to  the  surface.  Noise  differences  may  also  be  at¬ 
tributed  to  vehicle  speed,  the  load  being  carried,  and  the  level  of  mainte¬ 
nance.  Meteorological  conditions  and  their  effect  on  acoustic  sensor 
performance  will  be  discussed  in  the  following  section. 

1.1  Meteorological  Conditions  and  Acoustic  Sensor 
Performance 

The  performance  of  acoustic  sensor  systems  has  been  observed  to  vary 
widely  through  the  diurnal  cycle,  being  at  its  best  at  night  and  at  its  worst 
at  midday.  These  variations  in  performance  can  be  traced  to  changes  in 
meteorological  conditions  that  affect  both  acoustic  propagation  and  the 
background  noise  levels. 

The  performance  of  an  acoustic  sensor  is  ultimately  determined  by  the 
SNR  available  at  the  processing  system  before  various  processing  tech¬ 
niques  are  applied  to  improve  the  quality  of  the  signal.  The  SNR  is  ex¬ 
pressed  by  the  passive  sonar  equation 

SNR  =  SL-TL-NL  ,  (1) 

where  SL  is  the  source  level,  TL  is  the  transmission  loss,  and  NL  is  the 
background  noise  level.  Both  TL  and  NL  are  determined  by  the  meteoro¬ 
logical  conditions  at  the  test  site.  Transmission  losses  depend  on  how  well 
the  acoustic  waves  propagate  through  an  atmosphere  stratified  by  changes 
in  temperature  and  wind  velocity.  Noise  levels  (those  not  caused  by  man¬ 
made  or  cultural  sources)  are  caused  by  the  turbulent  flow  of  air  over  the 
microphones. 

1.1.1  Acoustic  Propagation  Losses 

As  sound  waves  travel  through  the  atmosphere,  they  are  refracted  up  or 
down  by  changes  in  the  sound  velocity  profile  (SVP).  The  SVP  is  deter¬ 
mined  by  the  variations  of  temperature  and  wind  velocity  as  a  function  of 
height,  and  these  are  likely  to  change  through  the  course  of  the  day. 

The  best  propagation  conditions  occur  at  night,  when  the  lower  levels  of 
the  atmosphere  are  colder  than  the  upper  levels.  This  produces  a  positive 
gradient  in  the  SVP,  a  condition  that  causes  sound  waves  to  bend  down¬ 
ward,  making  it  easier  for  them  to  travel  from  source  to  receiver.  An  oppo- 
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site  condition  occurs  during  the  day,  when  the  lower  levels  of  the  atmo¬ 
sphere  become  warmer  than  the  upper  levels.  The  result  is  a  negative  gra¬ 
dient  in  the  SVP,  a  condition  that  causes  sound  waves  to  bend  upward, 
making  it  more  difficult  for  them  to  travel  from  the  source  to  the  receiver. 
In  some  conditions,  the  degree  of  bending  is  such  that  sound  waves  cannot 
reach  the  receiver  other  than  indirectly,  after  being  scattered  by  upper-air 
turbulence.  This  is  called  a  shadow  zone. 

Diurnal  effects  are  more  pronovmced  in  the  desert,  where  the  lack  of  veg¬ 
etation  and  clear  dry  air  make  the  cycle  of  heating  and  cooling  of  the 
ground  and  the  lower  levels  of  the  atmosphere  more  pronounced. 

With  the  use  of  a  propagation  model,  the  propagation  losses  (TL)  can  vary 
by  up  to  15  dB  between  the  hours  of  5:00  a.m.  and  1:00  p.m.  solely  on  the 
basis  of  changes  in  the  temperature  profile  (without  the  sensor  being  in  the 
shadow  zone). 

1.1.2  Background  Noise  Levels 

When  set  up  outdoors,  microphones  are  always  protected  by  windscreens; 
nevertheless,  wind  noise  still  significantly  limits  the  performance  of  the 
acoustic  sensors.  Wind  noise  originates  in  two  ways:  First,  turbulence  is 
created  downstream  from  the  windscreen,  generating  pressure  variations 
that  are  indistinguishable  from  acoustic  noise;  second,  turbulence  gener¬ 
ated  upstream  from  the  windscreen  (from  vegetation,  thermals,  etc)  is  con- 
vected  past  the  microphones,  generating  pressure  variations  that  are  re¬ 
corded  as  noise.  Of  these  two  effects,  the  latter  is  by  far  the  more 
important.  The  random  pressure  fluctuations  induced  by  flow  are  not 
propagating  sound  waves,  so  their  effect  decays  exponentially  as  the  dis¬ 
tance  from  the  microphone  to  the  surface  of  the  windscreen  increases.  Size, 
therefore,  is  the  best  quality  in  a  windscreen,  overshadowing  shape  or 
choice  of  materials. 

In  the  absence  of  storms  or  other  unusual  phenomena,  winds  near  the  sur¬ 
face  decrease  substantially  at  night  and  become  less  turbulent.  This  re¬ 
duces  the  background  noise  level  considerably,  a  factor  which  further  ex¬ 
plains  the  improved  performance  of  acoustic  sensors  during  the  night. 

Considering  the  effects  of  propagation  and  background  noise  levels  as 
quantified  in  the  passive  sonar  equation,  we  expect  to  see  substantial  dif¬ 
ferences  in  the  performance  of  an  acoustic  sensor  at  different  times  of  the 
day.  Fortunately,  variations  in  the  performance  level  of  acoustic  surveil¬ 
lance  sensors  is  in  line  with  requirements  for  their  use  in  tactical  situations. 
Night  reduces  the  utility  of  visual  sensors,  just  when  the  threat  of  surprise 
attacks  is  greater.  Under  these  conditions,  acoustic  sensors,  operating  at 
their  maximum  level  of  performance,  are  likely  to  yield  the  most  benefits. 
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1.2  Remote  Netted  Acoustic  Detection  System  (RNADS) 
Concept 

The  Army  Research  Laboratory  (ARL)  has  developed  a  Remote  Netted 
acoustic  detection  system  (RNADS)  for  the  detection  of  ground  vehicles 
and  air  targets.  RNADS  is  composed  of  acoustic  sensor  arrays  placed  in  the 
battlefield,  a  network-control  processing  facility  outside  of  the  battlefield, 
and  a  radio  link  from  the  remote  sensors  to  the  network  control.  RNADS 
monitors  movement  over  an  area  of  interest  by  detecting  the  acoustic  emis¬ 
sions  of  vehicles  and  air  targets.  Once  the  target  is  detected,  the  sensors 
determine  and  transmit  the  target's  line  of  bearing  relative  to  the  sensor, 
along  with  other  pertinent  information,  to  the  network  control  where  pro¬ 
cessing  is  performed  to  determine  the  target  track.  The  system  is  capable  of 
tracking  multiple  targets  in  real  time.  Figure  1  illustrates  the  functionality 
of  RNADS.  This  report  documents  the  development  and  testing  of 
RNADS. 

1.3  RNADS  Objectives 

The  objectives  of  the  RNADS  program  are  to 

•  evaluate  and  enhance  acoustic  sensor  algorithms  in  a  multi-target 
environment; 

•  evaluate  and  enhance  tracking  algorithms  in  a  multi-target  environment; 


Figure  1.  RNADS 
functionality. 
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•  demonstrate  passive  target  tracking  in  real  time  in  a  multi-target  environ¬ 
ment;  and 

•  increase  the  database  of  acoustic  signatures. 

To  satisfy  these  objectives,  a  team  of  government  and  contractor  personnel 
was  formed,  sponsored  by  the  ARL  Advanced  Technology  Management 
Organization.  A  rigorous  research,  development,  and  testing  program  was 
initiated  to  complete  the  project  on  time  and  demonstrate  passive  acoustic 
x-y  tracking  in  real  time  during  an  Israeli  field  exercise,  as  part  of  a  coop¬ 
erative  technology  exchange  program  between  the  U.S.  and  Israel. 
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2.  RNADS  System  Overview 

RNADS  comprises  a  number  of  remote  acoustic  sensors,  a  network  control 
facility,  and  communications  processors  (CPs).  The  main  function  of  the 
remote  sensor  is  to  detect  targets  within  the  sensor's  field  of  regard  and 
calculate  target  direction  relative  to  the  sensor.  This  information  is  then 
packetized  and  sent,  using  the  CP,  to  the  network  control  processing  facil¬ 
ity.  A  low-cost  packet  radio  (LPR)  was  used  to  transmit  the  data  packets. 
An  HDLC  interface  provides  bidirectional  communications  between  the 
remote  site  and  the  network-control  processing  facility.  At  that  facility, 
tracking  algorithms  associate  multiple  lines  of  bearings  to  generate  target 
tracks.  These  tracks  are  displayed  on  a  Sxm  workstation,  along  with  terrain 
and  other  information.  A  meteorological  station,  which  collects  wind 
speed,  wind  direction,  temperature,  barometric  pressure,  and  relative  hu¬ 
midity,  is  placed  at  most  remote  sites.  Figure  2  shows  an  overview  of  the 
RNADS  system. 


2.1  Sensor  Architecture 


Figure  2.  RNADS 
system  overview. 


The  RNADS  sensors  are  passive  acoustic  sensors  designed  to  detect,  local¬ 
ize,  track,  and  classify  groimd  and  air  vehicles  at  medium  to  long  ranges. 
The  architecture  of  the  RNADS  sensors  was  derived  from  the  advanced 
passive  sonar  systems  used  by  the  U.S.  Navy. 

Each  remote  sensor  site  consists  of  an  acoustic  sensor  processing  imit  and 
associated  microphones,  a  Global  Positioning  System  (GPS)  receiver,  a 
digital  audio  tape  (DAT)  recorder,  an  LPR,  and  a  CP.  The  CP  provides  the 
interface  between  all  sensor  site  elements. 


The  sensor  transducer  array  consists  of  a  seven-element  circular  array  of 
microphones  connects  to  a  preamplifier  box.  A  100-ft-long  multi-conduc¬ 
tor  cable  connected  the  preamplifier  box  to  the  processing  unit,  imple¬ 
mented  on  a  rugged,  transportable  personal  computer  (PC).  The  PC  con¬ 
tains  an  anti-aliasing  filter  board,  an  analog-to-digital  converter  board 
(A/D),  and  a  digital  signal  processing  (DSP)  board.  State-of-the-art  signal 
processing  algorithms  were  implemented  in  C  to  perform  the  required 
functions. 
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The  sensor  prepared  messages  containing  the  estimated  target  bearing,  the 
frequencies  of  the  main  peaks,  and  the  target  types,  and  passed  these  mes¬ 
sages  to  a  CP  over  an  RS232  interface.  The  CP  distributed  the  data  through 
the  network  using  LPRs.  Both  ac  and  dc  options  are  available  for  supply¬ 
ing  power  to  the  remote  sensor.  Figure  3  shows  the  remote  site  compo¬ 
nents,  which  include  the  sensor  and  CP.  The  remainder  of  this  section  will 
describe  the  sensor  system  hardware,  algorithms,  and  software. 


2.1.1  Acoustic  Sensor  Hardware 


The  hardware  architecture  for  the  acoustic  sensor  is  shown  in  figure  4. 


The  acoustic  sensor  array  used  Knowles  BL1994  ceramic  microphones. 
They  are  rugged,  inexpensive,  instrumentation-quality  transducers.  The 
sensing  array  consisted  of  seven  microphones — six  forming  a  circle  with 
the  seventh  in  the  center.  The  circle  had  a  diameter  of  8  ft.  The  size  of  the 
array  was  chosen  to  provide  good  directivity  at  the  lower  frequencies.  The 
number  of  microphones  was  determined  by  the  number  of  charmels  in  the 
A/D  converter  (eight)  and  the  desire  to  keep  the  computational  load  at  a 
low  level.  The  microphones  were  placed  on  aluminum  spikes  driven  into 
the  ground.  The  spikes  were  positioned  with  the  aid  of  a  jig  with  a  built-in 
magnetic  compass. 


Figure  3.  Remote 
sensor  components. 


The  microphones  were  covered  by  open-cell  foam  windscreens  6  in.  in  di¬ 
ameter.  The  windscreens  were  originally  gray,  and  when  they  were  placed 
near  the  ground  in  low  grass,  they  were  hard  to  detect  from  a  distance.  Ex- 


Figure  4.  RNADS 
acoustic  sensor 
hardware 
architecture. 
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posure  to  sunlight  changed  the  color  to  an  olive  green,  making  visual 
detection  even  more  difficult.  The  acoustic  properties  did  not  seem  to  be 
affected. 

The  preamplifier  box  had  two  functions:  It  provided  power  to  the  micro¬ 
phones  (5  V),  and  amplified  signals  from  eight  channels  before  sending 
them  over  the  cable  to  the  processor.  Having  preamplifiers  for  all  eight 
channels  proved  useful  on  several  occasions  when  there  was  electrical 
trouble  in  one  of  the  preamplifier  boxes  or  cables.  We  were  often  able  to 
bypass  the  difficulty  by  using  the  spare  channel  and  reconfiguring  the  ar¬ 
ray  in  software.  The  preamplifier  circuit  could  provide  switch-selectable 
gains  of  40  and  60  dB.  The  preamplifier  boxes  could  get  power  from  three 
9-V  batteries  or  through  the  cable  from  the  filter  card. 

The  cable  had  16  shielded  wires  and  was  100  ft  long.  Eight  signals,  a 
ground,  and  ±12  V  ran  through  the  cable.  The  end  connecting  to  the 
preamplifier  was  a  16-pin  circular  connector;  the  other  end  had  a  DB-25 
(RS-232  type)  connector,  which  could  be  connected  to  the  filter  board  in 
the  ruggedized  PC,  to  a  digital  tape  recorder,  or  with  a  short  ribbon  cable 
jumper  to  both. 

The  filter  board  was  a  half-size  PC  card  that  fit  into  the  ruggedized  PC.  It 
had  eight  4-pole,  300-Hz  lowpass  filters  (frequency  devices  796BT-4,  300 
Hz)  and  a  module  to  convert  12  V  from  the  PC's  bus  to  isolated  ±12  V  for 
the  filters  and  the  preamplifier  box.  Signals  are  sent  from  the  filter  board  to 
the  A/D  converter  via  a  50-wire  flat  cable. 

The  A/D  converter  was  a  commercially  available,  16-bit  system  with  si¬ 
multaneous  sample-and-hold  (data  translation  DT2809).  The  simultaneous 
sample  and  hold  (SS&H)  feature  captures  data  from  all  channels  at  the 
same  time.  This  simplifies  the  software  by  eliminating  the  need  to  compen¬ 
sate  for  sampling  delays  between  channels. 

The  DSP  board  was  a  commercially  available  board  (Ariel  MM-96)  that 
had  two  Motorola  96002  DSP  chips,  192K  words  of  static  random-access 
memory  (RAM)  and  1  Mword  of  d5mamic  RAM. 

2.1.2  Sensor  Software 

The  software  for  the  RNADS  sensor  may  be  divided  into  development  and 
distribution  software  suites.  The  development  software  suite  includes  the 
Intermetrics  and  Microsoft  C  compilers,  the  Ariel  C  Demo  software,  and  a 
number  of  developed  utilities  for  hardware  debugging  and  data  reduction. 
The  distribution  software  suite  has  the  source  and  executable  code  for  both 
the  PC  and  Ariel  board,  as  well  as  data  files  specifying  the  sensor  array,  the 
overall  configuration,  and  the  target  classifier  data. 

The  software  for  the  Ariel  board  is  written  in  Intermetrics  C.  The  fast  Fou¬ 
rier  transform  (FFT)  routine  is  written  in  Assembly  language.  Currently, 
all  the  code  runs  on  one  of  the  two  DSP  chips  (DSP  A).  The  program  is 
stored  in  the  "outer  static  RAM";  the  data  are  in  the  "inner  static  and  dy- 


namic  RAMs."  This  change  from  earlier  versions,  where  almost  everything 
is  stored  in  the  inner  RAMs,  results  in  substantially  faster  nm  cycles  (about 
a  factor  of  two),  but  has  pushed  the  information  stored  in  the  outer  RAM 
to  more  than  16  Kwords,  necessitating  the  use  of  64-K  static  RAMs. 

The  Ariel  board  software  takes  data  from  the  PC  program  and  converts  it 
into  line-of-beaiing  data.  Spectrum  data  are  generated  and  sent  to  the  PC. 
The  general  program  flow  is  shown  in  figure  5. 

The  following  are  descriptions  of  each  of  the  data  flow  blocks  shown  in 
figure  5. 

Input. — ^Data  from  seven  microphones  are  sampled  at  1024  Hz  and  used  as 
input. 

2048-point  FFT  spectra. — Each  channel  of  data  is  Hamming  windowed 
and  fed  through  the  FFT.  The  time-versus-frequency  plot  is  displayed  on 
the  PC. 

Beamforming. — Currently  12  beams,  equally  spaced  around  the  circle,  are 
defined;  for  every  frequency  between  the  low-  and  high-beamformer  fre¬ 
quencies  (20  to  250  Hz),  a  magnitude  in  the  beam  direction  is  calculated. 
The  beam  calculation  may  be  done  using  a  delay  sum  or  a  singular  value 
decomposition  (SVD)  beamformer.  For  any  desired  frequency,  the  bearing 
is  determined  by  applying  a  centroid  over  the  strongest  beam  and  adjacent 
beams.  The  number  of  beams  and  low  and  high  frequencies,  as  well  as  the 
beamformer  type,  are  selectable  in  the  parameter  files.  A  time-versus- 
azimuth  plot  is  also  displayed  on  the  PC. 

Peak  picking  and  HLA. — A  frequency  peak  has  an  amplitude  that  is  a 
specified  amovmt  higher  than  other  peaks  in  its  neighborhood.  Three  peak 
pickers,  median,  Wiener,  and  histogram,  are  available  and  selectable 
through  the  configuration  files.  Each  generates  a  list  of  frequency  peaks. 

Harmonic  line  set  (HL  set). — The  HL  set  is  a  set  of  frequency  peaks  that 
are  harmonically  related  to  each  other.  The  harmonic  line  association 
(HLA)  algorithm  takes  the  strongest  peak,  P,  in  the  frequency  peak  list 
and,  subject  to  some  constraints,  assumes  that  it  is  the  kth  harmonic  of  a 


Figure  5.  RNADS 
sensor  software  data 
flow. 


15 


fundamental  frequency,  f  (P  =  k*F);  then  the  total  signal  strength  in  the  HL 
set  is  calculated.  The  k  that  gives  the  maximum  signal  strength  is  assumed 
to  be  correct.  A  set  of  features  corresponding  to  the  signal  strength  in  deci¬ 
bels  is  generated.  The  process  is  repeated  for  any  peaks  that  have  not  been 
used. 

Generate  tracks. — ^The  strongest  HL  set  is  assumed  to  be  associated  with  a 
target.  If  weaker  HL  sets  are  close  enough  in  bearing,  they  are  assumed  to 
be  associated  with  the  same  target  (for  example,  the  HL  sets  associated 
with  engine  noise  and  track  noise  in  a  tank).  After  this  simple  combining  of 
HL  sets  is  done,  the  HL  sets  are  associated  with  tracks.  There  are  three 
associators,  selectable  from  the  parameter  files: 

•  Dummy  associator.  Each  HL  set  is  reported  as  a  track.  This  eliminates  "track 
history,"  but  may  be  desirable  for  testing,  or  if  there  is  a  powerful  multi¬ 
sensor  fusion  algorithm  elsewhere  in  the  system. 

•  Alpha-beta  associator.  The  track  bearing  is  projected  ahead  using  an  alpha- 
beta  tracker.  The  HL  set  nearest  to  the  projected  position  is  associated  with 
the  track. 

•  MAP  associator.  The  track  bearing  is  projected  ahead  using  a  maximal  a 
posteriori  (MAP)  tracker.  The  HL  set  nearest  to  the  projected  position  is 
associated  with  the  track. 

Assign  target  classes. — The  track  maintains  a  list  of  features  (decaying  ex¬ 
ponential  filter  on  the  feature  data  in  the  associated  HL  set),  which  is  fed 
into  a  classifier  (currently  a  quadratic  log  likelihood  estimator  is  used).  The 
target  class  that  best  fits  the  track  features  is  reported. 

Generate  and  send  out  lines  of  bearing  (LOBs). — The  LOB  structures  are 
filled  in  from  track  data  and  the  Ariel  board  tells  the  PC  that  the  LOB  data 
are  ready. 

2.2  Network  Control  Architecture 

The  RF  communications  link  between  the  remote  sensor  sites  and  the  net¬ 
work  control  processing  facility  (NCPF)  is  via  an  AN/PRC118( )  LPR.  The 
LPR  uses  the  Survivable  Radio  Network  (SURAN)  protocol  to  ensure  reli¬ 
able  communications  between  all  nodes  in  the  network.  The  LPR  receives 
packets  of  data  from  an  attached  device  (i.e.,  remote  site  CP  or  NCPF),  via 
an  HDLC  link.  The  LPR  transmits  the  packet  in  a  spread-spectrum  signal 
at  either  400  Kbps  or  100  Kbps  to  a  neighboring  LPR.  The  receiving  radio, 
upon  receiving  a  good  packet,  will  transmit  an  acknowledgment  back  to 
the  transmitting  station.  If  no  acknowledgment  is  received,  the  packet  will 
be  retransmitted.  Any  LPR  in  the  network  can  be  used  as  a  relay  if  point- 
to-point  communications  are  not  possible. 

2.2.1  Communications  Architecture  of  Remote  Sensor  Sites 

The  CP  performs  many  functions.  Its  primary  function  is  to  collect  LOB  re¬ 
ports  from  the  acoustic  sensor,  packetize  them  into  a  format  acceptable  to 

16 


the  LPR  network,  and  finally  to  transmit  the  packets  via  the  HDLC  card 
and  the  LPR  network  to  the  NCPF.  In  addition  to  this  task,  many  others 
need  to  be  performed  by  this  element.  It  must  periodically  collect  informa¬ 
tion  from  the  GPS  receiver  in  order  to  ascertain  the  location  of  the  node,  as 
well  as  the  current  time.  It  must  send  this  time  back  to  the  acoustic  sensor 
in  order  to  maintain  an  accurate  time  within  the  sensor's  processor.  The  lo¬ 
cation  of  the  node  must  be  packetized  and  transmitted  to  the  NCPF.  Fi¬ 
nally,  the  CP  must  also  be  capable  of  receiving  a  request,  via  the  LPR  net¬ 
work,  from  the  NCPF. 

The  received  message  will  be  directed  to  the  DAT  recorder,  acoustic  sen¬ 
sor,  or  to  the  CP.  Commands  to  the  DAT  can  include  any  command  avail¬ 
able  through  the  attached  GP-300/GP-301.  These  commands  include  but 
are  not  limited  to:  RECORD,  STOP,  PAUSE,  SEARCH  for  COUNTER 
EVENT,  REQUEST  COUNTER  VALUE,  etc.  Commands  to  the  CP  include 
instructions  to  get  a  new  GPS  fix  and  to  reboot  the  acoustic  sensor.  Com¬ 
mands  to  the  acoustic  sensor  will  include  instructions  to  load  new  soft¬ 
ware  or  change  parameters  on  the  current  software.  All  commands  can  be 
set  to  be  executed  immediately  or  at  some  time  in  the  future.  The  CP  oper¬ 
ates  as  a  diskless  system  booting  from  erasable  programmable  read-only 
memory  (EPROM)  stored  MS  DOS.  The  entire  communications  processing 
and  interface  software,  developed  in  C,  is  loaded,  in  executable  form,  into 
the  CP  EPROMs.  The  CP  software  includes  a  "watchdog"  program  that 
reboots  the  system  if  the  software  "hangs  up"  or  there  is  an  interruption  of 
power. 

The  NCPF  consisted  of  a  CP  and  four  SUN  SPARCstations.  A  schematic  of 
the  NCPF  is  shown  in  figure  6.  The  NCPF  is  interfaced  to  the  network  via 
a  CP  that  is  identical  in  function  to  the  sensor  site  CP.  The  NCPF  CP  does 
not  include  a  GPS  receiver  or  IEEE  488  interface  card.  The  NCPF  software 
functions  are  split  between  a  SPARCstation  II  and  a  SPARCstation  10  for 
the  tracker  and  software.  The  SPARC  10  is  used  for  sensor  data  processing, 
while  the  SPARC  II  provides  the  display  processing  and  generation  and 
system  control  function.  The  NCPF  uses  the  UNIX  concept  of  "sockets" 
and  "pipes"  to  move  data  between  the  two  SUN  SPARCstations.  The  re¬ 
maining  SPARCstations,  a  SPARC  1+  and  SPARC  2,  were  used  by  IIT 
Research  Institute  (IITRI)  for  tracking,  display,  and  data  logging. 


Figure  6.  Network 
control  processing 
facility. 
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2.3  Tracking  Algorithms 

A  number  of  tracking  algorithms  were  developed  to  interface  with  the 
RNADS.  The  tracker  combines  information  received  from  every  sensor  ar¬ 
ray  and  generates  tracks  related  to  detected  targets.  One  tracker  uses  a 
multiple-h5^othesis  data  association  logic  and  a  linear  Kalman  filter  for  fix 
incorporation.  Another  uses  multiple-hypothesis  logic  and  an  extended 
Kalman  filter  for  fix  incorporation.  A  third  tracker  that  was  developed 
uses  a  nearest-neighbor  data  association  algorithm  and  an  extended 
Kalman  filter.  In  this  section  we  describe  the  tracking  algorithms. 

2.3.1  Acoustic  Tracker  Using  Multiple  Hypothesis  Logic  and 
Linear  Kalman  Filter 

This  tracker  uses  a  multiple  hypothesis  tracker  (MHT),  which  consists  of 
two  correlation  processes  in  tandem.  The  first  correlation  process,  on  a 
scan-by-scan  basis,  correlates  pairs  of  lines  of  bearing  received  from  acous¬ 
tic  sensors  and  generates  measurement  data  points.  Each  data  point  gener¬ 
ated  consists  of  X  and  y  location  coordinates,  an  estimate  of  the  accuracy  of 
the  location,  the  time  the  target  was  at  the  location  coordinate,  and  a  target 
classification.  Multiple  data  points  generated  by  the  intersection  of  mul¬ 
tiple  LOBs  originating  from  the  same  target  are  merged,  using  a  modified 
AGNES  clustering  algorithm,  into  a  single  composite  data  point  called  a 
"measurement."  The  second  process  correlates  prior  scan  measurements 
(called  tracks)  with  current  scan  measurements  using  a  sum-of-the-squares 
chi  square  gating  technique.  Each  new  data  point  forms  two  or  more 
hypotheses: 

•  Hypothesis  1  is  that  the  measurement  is  a  new  target  data  point  not  previ¬ 
ously  reported, 

•  Hypothesis  2  is  that  it  is  a  false  alarm  (not  a  target  at  all),  and 

•  Hypotheses  3  through  n  (where  n  is  any  integer  greater  than  3)  is  that  the 
new  data  point  "gates"  (correlates)  with  one  or  more  older  target  tracks 
generated  on  previous  scans. 

If  the  new  measurement  data  are  determined  to  be  associated  with  a  target 
track  from  a  previous  scan,  the  new  measurement  data  are  used  to  update 
the  previous  target  track.  The  update  is  accomplished  using  a  Kalman  fil¬ 
ter  technique.  The  Kalman  filter  evaluates  the  new  measurement  data  and 
their  associated  errors  with  the  old  target  track  data  and  associated  errors, 
and  decides  how  much  the  new  measurement  data  will  influence  the  old 
target  track  projected  forward  in  time.  Each  hypothesis  is  scored  based 
upon  the  "believability"  of  the  data.  A  target  track  that  is  updated  on  sub¬ 
sequent  scans  is  more  "believable"  than  one  that  is  not  updated  or  one  that 
is  sporadically  updated.  Target  tracks  whose  scores  reach  a  pre-defined 
level  are  declared  valid  target  tracks  reported  as  such,  and  displayed  on 
the  CRT.  A  valid  target  track  report  includes  the  target's  location,  speed 
and  direction,  time  of  the  report,  and  target  classification.  Figure  7  pro¬ 
vides  a  top-level  overview  of  the  MHT  architecture. 


2.3.2  Tracker  Algorithms  Using  Multiple  Hypothesis  Logic 
with  Extended  Kalman  Filter 


This  tracking  algorithm  uses  the  sensor  LOBs  as  the  information  source  for 
the  determination  of  target  number  and  position.  The  algorithm  attempts 
to  isolate  targets  and  maintain  an  accoimt  of  their  time  history  by  grouping 
fixes  into  plausible  target  tracks,  as  illustrated  in  figure  8. 

With  each  fix,  the  current  estimate  of  the  target's  state  is  adjusted  to  better 
refine  tracking  accuracy.  For  the  RNADS,  the  target  states  that  are  esti¬ 
mated  are  the  target's  x  and  y  positions  and  velocity. 


To  accomplish  these  functions,  the  tracking  algorithm  can  be  partitioned 
into  two  parts:  the  track/ measurement  association  logic  and  the  track  up¬ 
date  process.  These  two  algorithms  have  been  designed  and  implemented. 
The  difference  between  them  is  in  the  track/ measurement  data-association 
methodology. 


Figure  7.  MHT  with 
linear  Kalman  filter 
overview. 


One  tracking  algorithm  uses  a  sophisticated  data-association  algorithm 
that  formulates  all  possible  measurement/track  combinations  each  time  a 
measurement  set  is  received.  This  list  of  track  combinations  is  combined 
into  hypotheses  that  account  for  all  plausible  combinations  of  the  sensor 
measurements.  The  hypotheses  are  scored  each  measurement  cycle,  and 
the  tracks  in  the  highest  scoring  hypothesis  are  designated  the  tracking 
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solution  for  that  iteration.  The  strength  of  this  data-association  methodol¬ 
ogy  is  the  ability  to  recover  from  a  series  of  "bad"  measurements.  Since 
plausible  tracks  are  maintained  that  are  not  a  part  of  the  top-scoring  hy¬ 
pothesis,  later  measurement  information  can  associate  with  these  tracks 
and  move  them  into  the  top  hypothesis,  if  in  fact  they  are  the  real  target 
paths.  This  data  association  methodology,  MHT,  uses  an  algorithm  pre¬ 
sented  by  Reid  in  1979  [1].  A  top-level  algorithm  flow  is  shown  in  figure  9. 

The  second  methodology  is  the  nearest-neighbor  data  association.  This 
technique  seeks  the  unique  pairing  of  measurements  to  tracks  that  opti¬ 
mize  some  scoring  criterion  across  the  entire  pairing  solution.  With  this  al¬ 
gorithm,  assignments  are  irrevocably  made;  the  unique  track  solution  set 
is  carried  forward  without  alternative  solutions.  The  heart  of  this  algo¬ 
rithm  is  the  solution  of  the  track/ measurement  assignment  matrix.  The 
matrix  is  formed  by  assigning  a  score  for  each  measurement/ track  pairing. 
The  score  reflects  the  "distance"  of  the  measurement  from  the  track;  low 
scores  are  given  to  measurements  that  lie  near  the  track.  Figure  10  shows 
an  example  assignment  matrix.  The  999  values  reflect  a  measurement  to 
track  assignment  that  is  implausible;  the  distance  between  track  and  meas¬ 
urement  is  so  large  that  there  is  no  probability  that  the  measurement  came 
from  that  track.  The  circled  values  are  the  optimal  solution  for  this  matrix; 
i.e.,  there  is  no  set  of  pairings  that  sums  to  a  lower  total  number.  The  code 
that  is  implemented  in  the  nearest  neighbor  tracker  to  find  the  solution  to 
the  assignment  matrix  is  based  on  a  modified  Munkres  algorithm  [2].  A 
top-level  flow  diagram  is  shown  in  figure  11. 

The  other  portion  of  each  of  the  tracker  algorithms  is  the  track  update  pro¬ 
cess.  Once  the  data-association  algorithm  has  made  the  measurement-to- 
track  assignments,  the  track  update  process  updates  the  estimates  of  each 
target's  state  (x  and  y  positions  and  velocity)  based  on  the  measurement 
information.  The  algorithm  that  is  used  for  this  process  is  an  extended 
Kalman  filter. 

The  Kalman  filter  is  a  recursive  algorithm  that  provides  the  optimal  solu¬ 
tion,  in  a  mean-square  error  sense,  to  the  linear  system  estimation  prob¬ 
lem.  When  the  system  is  nonlinear,  the  extended  Kalman  filter  algorithm 
must  be  used.  In  the  case  of  acoustic  tracking,  the  LOB  measurements  are  a 
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Figure  10.  Assignment 
matrix  example. 
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nonlinear  combination  of  two  of  the  states  (tan“^  fvmction  of  target  x  and  y 
positions).  The  difference  between  the  linear  and  extended  Kalman  filters 
is  a  linearization  of  the  nonlinear  system  d)mamics,  or  measurement  equa¬ 
tions  in  the  extended  case. 


The  discrete-time  extended  Kalman  filter  algorithm  goes  through  the  fol¬ 
lowing  steps  every  measurement  cycle: 

•  The  state  estimate  resulting  from  the  last  measurement  is  propagated  to 
the  time  that  the  current  measurement  is  received. 


•  The  covariance  of  the  state  is  propagated  to  the  time  that  the  current  meas¬ 
urement  is  received. 

•  The  filter  estimate  of  the  measurement  value  is  computed  based  on  the  tar¬ 
get  state  variables. 

•  The  Kalman  filter  gain  matrix  is  computed.  The  gain  matrix  is  used  to  de¬ 
termine  the  portion  of  the  difference  between  the  actual  measurement  and 
the  filter's  estimate  of  the  measurement  that  will  be  attributed  to  each 
state. 


•  The  state  estimate  is  updated  by  multiplying  the  gain  by  the  difference  in 
measurements  and  adding  the  result  to  the  propagated  state  estimate. 

•  The  covariance  of  the  state  is  updated  to  reflect  the  measurement. 
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The  measurement  update  equations  (gain,  state  update,  and  covariance 
update)  use  a  matrix  that,  when  matrix  multiplied  with  the  state  matrix, 
yields  the  filter  estimate  of  the  measurement.  The  geometry  of  figure  12  is 
used  to  define  this  matrix. 


Figure  12.  Acoustic 
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Heading 


Target-position  when 
signal  issued 


WfT  Target-position  when 

O  CdT  A  received 

'  Target  path 

„  ^ - ►  Sx,  Sy  =  sensor-location 

^  =  target  distance 

*X  C  =  speed  of  sound 
dT  =  propagation  time 
V  =  target  velocity 
LOB  =  line-of-bearing 
w  =  angular  displacement 


22 


3.  Summary  of  Field  Evaluations 

Field  evaluations  were  conducted  at  Aberdeen  Proving  Ground  (APG), 
MD,  and  in  Ze'elim,  Israel.  Three  separate  field  evaluations  were  con¬ 
ducted  at  APG  before  the  IsraeU  tests  in  order  to  verify  equipment  perfor¬ 
mance  and  characterize  the  sensors.  The  Israeli  test  consisted  of  two  parts: 
a  controlled  experiment  similar  to  the  APG  tests,  and  an  uncontrolled  test 
in  which  sensors  were  placed  in  a  battlefield  where  wargame  exercises 
were  taking  place.  In  the  course  of  the  field  tests,  a  number  of  ground  and 
air  targets  were  used.  The  tests  included  ground  vehicles  and  helicopters. 
Each  field  test  was  designed  to  evaluate  the  RNADS  for  single  and  mul¬ 
tiple  targets. 

This  chapter  describes  the  field  evaluations  and  the  sensor  and  tracker  per¬ 
formance.  The  first  section  describes  the  metrics  used  to  measure  sensor 
and  tracker  performance. 

3.1  Performance  Characterization 

Performance  metrics  were  developed  to  characterize  sensor  and  tracker 
performance  during  the  field  tests. 

3.1.1  Sensor  Characterization 

Sensor  performance  is  characterized  with  the  following  quantitative 
metrics: 

•  Fixed  angle  bias 

•  Fixed  time  bias 

•  Random  angle  error 

•  Probability  of  detection 

•  Probability  of  multiple  detections 

•  Probability  of  false  target  report 

3.1.1.1  Computing  fixed  angle  and  time  bias 

Ground  truth  data  were  obtained  for  each  field  test  run,  with  the  exception 
of  the  Israeli  uncontrolled  test.  Ground  truth  for  the  APG  tests  was  gath¬ 
ered  by  noting  the  time  at  which  the  target  vehicle(s)  passed  precisely  lo¬ 
cated  stakes  along  the  closed  course.  For  the  Israeli  controlled  test,  a  GPS 
receiver  on  the  vehicle  provided  the  ground  truth.  An  estimate  of  each 
sensor's  fixed  angle  and  time  bias  was  computed  by  comparing  reported 
sensor  measurements  with  a  computed  estimate  of  "true  measurement" 
values  based  on  ground  truth  measurements.  The  true  measurement  val¬ 
ues  accounted  for  speed-of-sound  propagation  delays. 
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For  fixed  angle  and  time  bias  determination,  false  fixes  were  removed 
from  the  data.  We  eliminated  these  false  fixes  manually  by  comparing  the 
measurement  stream  with  the  true  measurement  values.  Figure  13  shows  a 
plot  of  both  sensor  measurements  and  true  measurements.  The  circled  sen¬ 
sor  measurements  were  removed  to  compute  the  bias  values. 

After  false  fixes  are  removed,  the  time  bias  is  computed.  The  set  of  sensor 
and  true  measurements  are  differenced,  and  the  average  difference  is 
found.  This  process  is  repeated  with  the  sensor  data  set  shifted  in  time. 
When  the  average  difference  is  a  minimum,  the  time  shift  is  noted  as  the 
time  bias.  The  angle  bias  is  foimd  in  a  similar  maimer.  This  time,  however, 
the  sensor  measurement  set  is  shifted  in  angle  until  a  minimum  average 
difference  between  the  sensor  and  truth  measurement  set  is  found.  The 
process  used  to  determine  time  and  angle  bias  is  highlighted  in  figure  14. 

3.1.1.2  Computing  random  angle  error 

After  the  time  and  angle  bias  have  been  removed  from  the  sensor  data,  the 
random  angular  error  is  computed.  The  equation  is 


Random  bearing  angle  = 
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sensor  measurement 
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where  is  the  true  bearing  at  measurement  time  i,  Bmi  is  the  sensor 
measurement  at  time  i,  and  N  is  the  number  of  sensor  measurements. 

The  equation  for  the  random  error  can  be  interpreted  as  the  root  sum 
square  error,  or  the  standard  deviation. 

3. 1.1. 3  Computing  other  sensor  characterization  parameters 

The  remaining  sensor  characterization  parameters  relate  to  the  sensor's 
target  detection  capability.  is  the  probability,  per  reporting  period,  of 
detecting  a  target  when  the  target  is  within  sensor  coverage.  Sensor  cover¬ 
age  for  each  run  was  determined  manually  by  comparing  sensor  reports 
versus  the  true  measurement  line.  Time  periods  when  the  sensor  was  pro¬ 
viding  measurements  for  the  target  were  noted.  The  total  number  of  re¬ 
porting  times  that  at  least  one  target  measurement  is  reported  is  then  di¬ 
vided  by  the  total  number  of  seconds  of  sensor  coverage,  to  yield  Pd- 

The  probability  that  an  LOB  is  for  a  false  target,  Ppj,  is  foimd  by  dividing 
the  total  number  of  false  target  reports  by  the  total  number  of  LOBs  re¬ 
ported.  Multiple  reports  of  the  target  for  one  reporting  time  are  not  classi¬ 
fied  as  false  reports.  They  are  counted,  and  the  probability  that  a  report  is 
a  multiple  report  of  the  target,  P multiple'  t)y  dividing  the  count 

by  the  total  number  of  LOBs. 

3.1.2  Tracker  Performance  Metrics 

Tracker  performance  is  a  fimction  of  the  number  of  sensors  and  their  lay¬ 
out,  accuracy  of  the  sensor-provided  LOBs,  and  target  detection  character¬ 
istics  of  the  acoustic  sensors.  Since  these  characteristics  changed  from  test 
to  test,  it  is  not  possible  to  compare  tracker  performance  across  field  tests. 
Comparisons  can  be  made  across  nms  within  a  test,  however.  The  perfor¬ 
mance  metric  used  was  root  sum  square  (RSS)  tracker  error  from  the 
ground  truth.  The  computation  is  straightforward:  For  each  tracker  target 
position  output  (time,  x  position  estimate,  and  y  position  estimate),  the  cor¬ 
responding  true  vehicle  position  at  the  same  time  is  computed  from  the 
ground  truth  data.  The  difference  between  true  and  estimated  is  squared, 
and  the  result  summed  with  all  other  tracker  outputs.  The  total  summation 
is  divided  by  the  number  of  tracker  outputs,  and  the  square  root  of  the  re¬ 
sult  is  computed. 

This  metric  has  a  shortcoming.  It  does  not  penalize  the  tracker  for  losing 
track  of  the  target;  the  computations  are  only  made  when  the  tracker  has 
an  estimate  of  target  position. 


3.2  Aberdeen  Proving  Ground,  MD,  17  June-1  July  1992 

This  field  evaluation  was  the  first  opportunity  to  integrate  the  acoustic 
sensors  with  the  rest  of  the  tracking  system.  Since  this  was  the  first  full  in¬ 
tegration  of  the  system,  a  number  of  software  and  hardware  interface 
problems  were  discovered,  which  severely  limited  tracking  capability. 
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Although  tracking  was  not  successful  during  the  field  test,  this  test  pro¬ 
vided  the  opportunity  to  identify  interface  problems.  DAT  recorders  at 
each  remote  site  allowed  us  to  use  data  that  were  recorded  during  the  field 
test  to  modify  software  and  test  new  versions.  This  test  also  provided  sen¬ 
sor  placement,  documentation,  logistics,  and  test  planning,  which  proved 
to  be  valuable  on  future  field  tests. 

3.3  Aberdeen  Proving  Ground,  MD,  21-30  October  1992 

Another  field  test  took  place  at  the  Aberdeen  Proving  Ground,  to  accom¬ 
plish  real-time  tracking  of  single  and  multiple  targets,  and  to  gather  data 
that  would  allow  system  performance  characterization.  Two  additional 
sensor  algorithms  were  developed:  One  algorithm  used  an  alpha-beta 
tracking  algorithm  to  group  bearing  fixes  into  tracks,  and  the  other  used 
an  SVD  algorithm.  An  objective  of  this  set  of  tests  was  to  determine  the 
performance  of  each  algorithm  type. 

3.3.1  Test  Descriptions 

Over  the  four-day  test  period  of  26-29  October,  57  trials  were  conducted. 
For  the  trials  involving  ground  vehicles,  surveyed  markers  were  placed 
around  the  closed  course.  Ground  truth  was  generated  by  registering  the 
time  each  marker  was  passed  as  the  vehicle  transited  the  course.  For  the 
helicopter  trials,  GPS  data  were  collected. 

Campbell  Scientific  meteorological  stations  were  used  to  collect  tempera¬ 
ture,  relative  humidity,  barometric  pressure,  wind  speed,  and  directional 
data  at  several  of  the  sensor  sites  and  at  the  instrumentation  trailer.  Tem¬ 
perature,  relative  humidity,  and  barometric  pressure  were  recorded  each 
minute.  Temperature  and  wind  checks  were  made  regularly  and  used  to 
update  the  speed  of  sound  estimations  in  the  tracker. 

3.3.2  Sensor  Configuration 

The  course  layout  and  sensor  locations  are  shown  in  figure  15.  Sensor  posi¬ 
tions  3A  and  3B  show  alternative  locations  for  one  of  the  sensors.  All  trials 
except  four  were  conducted  with  the  sensor  in  position  3A.  The  last  four 
trials  were  conducted  with  only  sensor  3  operational  (in  position  3B).  This 
set  of  tests  was  conducted  to  obtain  additional  long-range  sensor  data. 

3.3.3  Sensor  Performance 

The  sensor  data  for  selected  runs  were  reduced  and  grouped  across  runs 
by  number  and  type  of  target  for  the  run. 


Figure  15.  APG  course 
and  sensor 
configuration, 
October  1992. 
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Using  the  sensor  characterization  parameters  described  in  section  3.1,  the 
sensor  performance  for  one-target  runs  using  the  alpha-beta  sensor  soft¬ 
ware  was  consistent  in  the  time  and  angle  bias  values. 

To  gain  further  insight  into  sensor  performance,  the  random  angle  error 
was  binned  by  range-to- target  in  100-m  increments.  The  Pp,  P^j,  and 
^Multiple  I'^sults  were  consistent  with  other  available  systems.  The  random 
error  was  low  for  short  range  to  target  data,  and  remained  low  for  the  du¬ 
ration  of  the  runs. 


When  the  number  of  targets  increases,  the  time  bias,  angle  bias,  and  ran¬ 
dom  error  were  found  to  be  consistent  with  the  single-target  rims.  For  two- 
target  runs,  Pjj  was  lowered  only  slightly,  and  the  Ppj  decreased.  This  re¬ 
duction  is  most  likely  due  to  the  sensor  reporting  a  fixed  number  of  LOBs. 
With  additional  targets  in  the  sensor's  field  of  regard,  more  real  detections 
will  occur  and  the  false  target  statistics  will  drop. 


3.3.4  Tracker  Performance 

3.3.4. 1  MHT  with  linear  Kalman  filter  tracker  performance 

Some  very  effective  tracking  was  accomplished  during  the  second  test. 
Single  vehicles  were  tracked  nearly  continuously  around  the  2.5-km  track. 
The  breaks  in  the  track  on  the  turns  were  caused  by  the  sensors  losing  lock 
due  to  a  sharp  change  in  sound  energy  and  frequency  as  the  vehicle 
slowed  to  make  the  turn. 

Multiple  vehicles  at  appropriate  spacing  were  tracked  well.  The  target 
tracks  had  more  breaks  than  in  the  single  vehicle  runs,  but  the  correlation 
algorithms  used  did  an  excellent  job  at  preventing  the  appearance  of  ghost 
tracks  due  to  miscorrelation  of  sensor  reports. 
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3.3.4.2  MHT  with  extended  Kalman  filter  tracker  performance 

A  number  of  nms  were  evaluated  to  determine  the  tracker  RSS  error.  The 
errors  for  the  single  target  nms  ranged  in  values  between  the  "loud"  and 
"quiet"  targets.  Some  sensors  were  not  reporting  information  to  the  tracker 
during  these  runs;  however,  most  of  the  tracking  degradation  was  due  to 
the  lower  signature  of  the  target. 

Tracker  performance  did  not  significantly  degenerate  on  the  two  target 
nms.  A  sample  plot  of  the  tracks  generated  by  the  tracker  for  a  typical  nm 
is  shown  in  figure  16. 

An  example  of  the  tracker  output  for  a  three-target  run  is  shown  in 
figure  17. 
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3.4  Aberdeen  Proving  Ground,  MD,  28  January-3  February 
1993 

The  final  preliminary  evaluation  was  used  primarily  to  test  additional 
pieces  of  equipment  that  had  been  constructed  or  received  since  the  previ¬ 
ous  evaluation.  Each  piece  of  equipment  planned  for  use  in  Israel  was 
tested  to  ensure  it  was  fully  operational. 

3.4.1  Test  Descriptions 

Five  sensors  were  used  in  this  set  of  field  evaluations.  A  total  of  16  single- 
and  multiple-target  trials  took  place.  The  time  bias,  angle  bias,  Pp,  Ppj,  and 
P Multiple  calculations  were  consistent  with  previous  tests. 

3.4.2  Tracker  Performance 

The  various  trackers  yielded  results  similar  to  the  previous  tests  when  ve¬ 
hicles  were  appropriately  separated. 

3.5  Field  Evaluations,  Ze'elim,  Israel,  1-18  March  1993 

The  demonstration  of  the  RNADS  was  conducted  in  Israel  in  conjimction 
with  a  brigade-level  training  exercise.  This  evaluation  consisted  of  two 
parts.  The  first  part  was  a  controlled  test  similar  to  the  evaluations  con¬ 
ducted  at  Aberdeen  Proving  Ground,  MD.  Test  targets  for  this  evaluation 
included  ground  vehicles  and  helicopters.  The  second  portion  of  the  evalu¬ 
ation  was  an  uncontrolled  test,  with  the  sensors  placed  along  the  perimeter 
of  battalion-  and  brigade-level  exercise  areas. 

3.5.1  Controlled  Test 

The  controlled  test  was  conducted  on  a  triangular  course  with  the  sensors 
more  widely  spaced  than  in  previous  tests.  The  remote  processing  setup 
was  in  a  control  tower  near  the  start  of  the  course.  Nine  sensors  were  used. 
The  geometry  is  shown  in  figure  18. 

During  the  controlled  test,  the  background  noise  level  at  the  sensors  was 
high  due  to  power  generators  near  the  control  tower.  Sensors  detected 
these  generators  as  stationary  sources. 

A  number  of  single  and  multiple  targets  were  used  at  varied  speeds  for 
these  experiments.  Target  spacing  varied  from  100  to  500  m. 

3.5. 2. 1  Sensor  performance 

The  sensor  data  for  each  run  were  reduced  and  grouped  across  runs  by 
number  and  type  of  target  for  the  run.  A  representative  set  of  sensor  meas¬ 
urements  and  associated  ground  truth  is  shown  in  figure  19. 
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Figure  18.  Sensor 
configuration  for 
controlled  test  in 
Ze'elim,  Israel. 
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Figure  19. 

Representative  sensor 
data. 


Sensor  performance  for  single-target  runs. — A  total  of  33,518  LOBs  were 
analyzed  from  eight  sensors  to  determine  P^,  Ppj,  PMultiple'  bias, 
angle  bias,  and  random  error.  Comparison  of  these  with  the  Aberdeen  re¬ 
sults  leads  to  the  following  conclusions: 

•  The  magnitude  of  the  time  bias  is  approximately  the  same  as  that  experi¬ 
enced  at  Aberdeen,  but  the  variance  among  sensors  is  greater  in  the  Israeli 
tests. 

•  The  magnitude  of  the  random  error  is  larger  in  these  tests  than  it  was  at 
Aberdeen.  The  cause  of  this  discrepancy  is  likely  due  to  the  adequacy  of 
the  ground  truth. 

•  Ppf  closely  matched  the  Aberdeen  results. 

•  Ppj  was  higher  than  in  the  Aberdeen  results.  A  partial  cause  of  this  dis¬ 
crepancy  is  a  number  of  low-level  aircraft  passing  the  test  site  to  the  west. 

•  ^Multiple  higher  than  it  was  at  Aberdeen.  It  is  thought  that  this  in¬ 

crease  is  a  by-product  of  the  increase  in  the  maximum  number  of  LOBs 
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that  each  sensor  could  report;  an  increase  from  three  at  Aberdeen  to  eight 
in  Israel.  The  percentage  of  LOBs  contained  in  the  multiple  reports  is 
greater  than  the  percentage  of  single-LOB  report  LOBs. 

As  was  the  case  during  the  Aberdeen  tests,  sensor  performance  dropped 
off  for  the  less  observable  target. 

For  the  Aberdeen  runs,  random  error  was  more  accurate  at  100  to  200  m 
range-to-target;  leveled  off,  and  increased  from  there  until  the  target  was 
out  of  detection  range.  In  the  Israeli  test,  the  random  error  is  higher  at 
ranges-to-target  less  than  a  few  hundred  meters.  It  is  this  large  error  that 
causes  the  overall  random  error  to  be  higher  than  the  Aberdeen.  The  cause 
of  this  large  error  at  shorter  ranges-to-target  is  attributed  to  GPS  ground 
truth  error.  The  GPS  used  on  the  targets  were  accurate  to  within  100  m. 
Figure  20  shows  the  number  of  degrees  of  sensor  error  that  inaccurate 
ground  truth  can  introduce. 

Pjj  as  a  function  of  target  range  was  calculated  for  300  to  2600  m  ranges  for 
the  single-target  runs.  Sensor  reported  LOBs-on-target  were  binned  by 
range-to-target  in  100-m  increments.  The  number  of  LOBs  that  should 
have  been  reported  for  each  range  bin  were  computed  from  the  ground 
truth.  The  results  were  comparable  to  the  APG  field  experiment. 

The  typical  versus  range  plot  showed  a  high  probability  of  detection  at 

close  ranges,  and  a  gradually  decline  as  the  range  increases. 

Sensor  performance  for  two-target  runs. — The  two-target  Pj-,  is  lower 
than  the  single-target  value,  while  the  two-target  Ppj  is  better  than  the 
single-target  value.  Again,  the  single-target  runs  have  a  number  of  aircraft 
targets  in  the  vicinity  which  the  sensors  did  track. 

The  two-target  runs  show  a  higher  random  error  than  was  the  case  for  the 
one-target.  Pp  is  also  greatly  reduced.  The  large  Ppj  value  can  be  attrib¬ 
uted  to  background  and  interfering  sources  such  as  the  generators. 


Figure  20.  Random 
error  versus  target 
range. 
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5.5.12  Tracker  Performance 

MHT  tracker  with  linear  Kalman  filter  performance. — The  first  set  of 
tests  was  conducted  using  a  single  target.  Excellent  tracks  were  main¬ 
tained  along  each  leg  of  the  course.  Target  tracks  were  fairly  close  to  the 
road  that  the  vehicle  traveled  on.  The  targets  had  to  stop  at  each  comer  for 
safety  reasons,  so  the  tracks  were  frequently  broken  at  that  point.  The  sec¬ 
ond  leg  of  the  course  was  very  hilly  with  numerous  short  but  very  steep 
hills.  We  feared  that  the  sensors  would  have  problems  maintaining  a  lock 
on  the  tanks  as  their  speed  changed  going  up  and  down  the  hills;  however, 
sensors  maintained  consistent  reporting.  Figure  21  shows  a  single  target 
being  tracked  by  eight  acoustic  sensor  arrays,  displayed  as  black  boxes. 
The  white  line  is  the  ground  truth  obtained  using  a  commercial  GPS  re¬ 
ceiver,  and  the  jagged  black  line  is  the  output  of  the  tracker. 

The  next  set  of  tests  were  with  two  targets  with  varying  separation.  Similar 
results  were  achieved  here  as  were  achieved  at  APG.  The  targets  had  prob¬ 
lems  maintaining  their  separation  and  frequently  ended  up  less  than  100  m 
apart.  Tracking  was  more  difficult  during  these  times.  Figure  22  shows  the 
tracking  of  two  similar  targets. 


Figure  21.  MHT 
tracker  with  linear 
Kalman  filter — eight 
sensors  reporting,  one 
target,  1-km  grid. 


Figure  22.  MHT 
tracker  with  linear 
Kalman  filter — eight 
sensors  reporting,  two 
targets,  1-km  grid. 
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For  tests  involving  multiple  vehicles,  the  tracks  were  generally  better  on 
the  more  pronounced  signatures.  Quieter  targets  broke  track  more  fre¬ 
quently.  As  expected,  good  tracks  resulted  when  sensor  performance  was 
good. 

MHT  tracker  with  extended  Kalman  filter  performance. — ^For  the  Israeli 
test,  the  nearest-neighbor  tracking  algorithm  was  used.  Pretest  analysis 
pointed  out  that  with  up  to  nine  sensors  reporting,  the  multiple  hypothesis 
algorithm  would  not  rim  in  real  time  with  more  than  three  or  four  LOB  re¬ 
ports  per  sensor. 

The  tracker  RSS  error  and  tracking  percentage  were  calculated  for  a  num¬ 
ber  of  single-  and  two-target  runs.  The  RSS  error  was  calculated  after 
removing  the  GPS  bias,  which  was  calculated  by  averaging  the  GPS- 
indicated  target  position  and  tracker-indicated  target  position  for  the  same 
reporting  times.  The  validity  of  the  computation  rests  on  the  assumption 
that  the  tracker  output  is  unbiased.  Analysis  of  the  Aberdeen  tests  shows 
the  tracker  to  be  unbiased. 

The  results  show  the  expected  trends:  Single-target  runs  are  better  than 
two-target  rims  of  the  same  ty^pe',  tracking  accuracy  against  the  less  observ¬ 
able  second  target  was  not  as  good  as  against  the  first  target;  and  tracking 
percent  drops  as  number  of  targets  increases  and  observability  decreases. 
The  general  conclusion  that  can  be  drawn  is  that  tracking  performance  fol¬ 
lows  sensor  performance. 


3.5.2  Uncontrolled  Test 

The  uncontrolled  portion  of  the  evaluation  was  conducted  in  two  parallel 
battalion-sized  attack  corridors  about  8  km  long.  The  two  corridors,  one 
3  km  wide  and  the  other  4  km  wide,  were  divided  by  a  road.  Three  sensor 
sites  were  set  up  along  the  road  at  approximately  2  km  spacing.  Three 
more  sensors  were  set  up  along  each  of  the  outside  edges  of  the  corridors. 
See  figure  23  for  the  layout  of  this  exercise.  Since  the  Israeli  army  was  con¬ 
ducting  live-fire  training,  the  sensors  had  to  be  set  up  well  in  advance  of 
the  evaluation  period.  By  the  start  of  the  maneuver  exercises,  only  six  sen- 


Figure  23.  Sensor 
layout  for 

uncontrolled  exercise. 
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sor  sites  remained  operational.  Three  sensors  were  down  before  the  exer¬ 
cise  was  started.  Attempts  to  restart  the  sensors  from  the  central  command 
site  were  unsuccessful. 

The  planned  maneuver  exercises  included  one  battalion-sized  armor  imit 
moving  down  each  corridor  (one  battalion  at  a  time),  while  conducting 
live-fire  training.  This  was  to  be  followed  by  a  battalion  on  battalion  ma¬ 
neuver  in  one  of  the  corridors.  The  actual  movement  and  timing  of  the  ex¬ 
ercises  is  not  known.  No  ground  truth  was  provided  and  the  maneuver 
area  was  not  within  sight  of  the  control  tower;  therefore  exact  target  posi¬ 
tioning  is  imknown  during  these  experiments. 

We  made  an  attempt  to  develop  tracks  with  the  paucity  of  data  by  adjust¬ 
ing  the  MHT  parameters  of  the  linear  Kalman  filter  tracker.  Although  sev¬ 
eral  tracks  were  formed,  it  appeared  that  in  most  cases  the  tracks  formed 
were  the  result  of  miscorrelations  and  ghost  tracks.  Only  the  closest  one  to 
three  targets  to  the  sensor  generated  a  sufficient  SNR  to  be  detected  and 
processed.  No  two  sensors  were  detecting  the  same  targets  at  the  same 
time.  Since  the  linear  Kalman  filter  MHT  algorithm  is  based  upon 
triangularization  of  LOBs  from  geographically  dispersed  sensors  hearing 
the  same  target,  conditions  for  tracking  were  not  satisfied. 

The  nearest-neighbor  tracker  was  capable  of  showing  the  general  direc¬ 
tional  flow  of  the  column  of  vehicles;  however,  in  general  tracking  was 
poor.  Additional  analysis  using  data  from  a  controlled  test  with  good 
ground  truth  is  necessary  to  determine  sensor  and  tracker  performance. 


4.  Conclusions 


The  RNADS  has  been  successfully  demonstrated  at  field  tests  within  the 
U.S.  and  outside  the  U.S.  as  part  of  a  demonstration  for  the  Israeli  govern¬ 
ment.  Real-time  passive  x-y  tracking  has  been  demonstrated  with  good  ac¬ 
curacy  for  multiple  vehicles.  The  following  conclusions  are  drawn  from 
the  sensor  and  tracker  analysis  performed: 

(1)  Sensor  performance  and  tracker  performance  were  shown  to  be  good  for 
single  targets,  and  both  begin  to  degrade  as  the  number  of  targets  increase. 
Pjj  would  drop  several  percentage  points  when  an  additional  target  is 
added.  How  much  the  value  dropped  often  depended  on  backgrovmd  con¬ 
ditions  and  interfering  sources.  Ppj  would  usually  decrease  when  addi¬ 
tional  targets  are  within  the  field  of  regard.  With  another  target  in  the  sen¬ 
sors'  field  of  regard,  the  sensors  reported  less  false  fixes.  The  tracker 
performance  followed  the  general  trend  of  the  sensor  performance.  RSS  er¬ 
ror  and  tracking  percentages  were  shown  to  decrease  with  increased  tar¬ 
gets  for  all  targets  observed. 

(2)  As  the  targets  become  less  separated,  the  sensors  had  more  difficulty  re¬ 
solving  the  targets  and  tracking  performance  suffered. 

(3)  A  time  bias  was  found  within  the  sensors.  The  data  characterization  al¬ 
lowed  for  the  removal  of  this  time  bias  in  processing  to  provide  better 
tracking.  The  cause  of  the  bias  is  believed  to  be  sensor-processing  related. 

(4)  An  angle  bias  in  the  sensors  was  determined  to  be  due  to  sensor  layout. 
This  can  be  easily  compensated  for  within  the  tracking  algorithms.  Careful 
placement  of  the  microphones  within  the  array  minimizes  this  bias.  Know¬ 
ing  the  magnetic  deflection  in  the  area  also  eliminated  compass-read  errors 
and  sensor-placement  errors. 

(5)  The  sensor-random  error  was  found  to  be  fairly  consistent  for  most  test 
ranges. 

(6)  As  expected,  Pq  was  shown  to  degrade  with  increasing  distance.  For  the 
controlled  experiments  and  tests  around  closed  paths,  quite  often,  the 
would  drop  dramatically  at  certain  points  along  the  path.  These  distances 
were  determined  turn  points,  where  the  target  would  slow  to  maneuver. 
When  the  engine  decreased  rpms,  the  overall  signature  became  less  ob¬ 
servable  and  detection  probability  dropped. 

(7)  As  the  number  of  targets  increased  dramatically,  as  was  the  case  in  the 
Israel  uncontrolled  experiment,  sensor  and  tracking  performance  de¬ 
graded  to  the  point  where,  at  times,  only  the  general  direction  of  flow 
could  be  determined.  Only  the  loudest  and  closest  targets  to  the  sensors 
were  tracked  for  short  periods.  Due  to  the  distance  between  operational 
sensors,  correlation  of  LOBs  between  sensors  was  difficult.  The  lack  of 
ground  truth  prevented  formal  data  characterization  and  performance 
analysis  on  these  data.  Additional  data  are  required  to  characterize  sensor 
and  tracker  performance  as  the  number  of  targets  increase  past  three  or 
four. 
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(8)  The  goals  and  objectives  of  this  project  were  fulfilled.  The  program  devel¬ 
oped,  enhanced,  and  integrated  a  set  of  sensor  and  tracking  algorithms 
needed  to  provide  tracking  in  a  multiple-target  environment.  These  algo¬ 
rithms  were  demonstrated  during  field  tests  within  the  U.S.  and  overseas 
as  part  of  a  U.S.-Israel  joint  technology  demonstration  program.  Also,  the 
database  of  single  and  multiple  targets  was  increased.  This  database 
includes  a  complete  set  of  ground  truth  data,  including  meteorological  and 
positioning  data  for  multiple  environmental  and  background  noise 
conditions. 

(9)  Acoustic  sensors  provide  a  unique  capability  not  found  in  conventional- 
based  sensors.  They  provide  an  inexpensive  and  excellent  adjunct  to  con¬ 
ventional  sensor  systems.  They  provide  passive  non-line-of-sight  detection 
and  tracking  capabilities  not  possible  with  radar-type  systems. 
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5.  Recommendations 

The  design  and  testing  of  the  RNADS  system  was  challenging.  Meeting 
and  fulfilling  the  objectives  of  this  project  were  possible  only  because  of 
the  cooperation  and  dedication  of  many  agencies  and  contractors.  The  fol¬ 
lowing  are  recommendations  from  this  team  for  system  enhancements  for 
future  applications  and  growth: 

(1)  Integrate  the  acoustic-processing  hardware  and  the  communications- 
processor  hardware  into  one  ruggedized,  weatherproof  container  to  in¬ 
crease  portability  and  reduce  logistics  problems.  The  overall  system  is 
bulky  and  difficult  to  transport  from  site  to  site. 

(2)  Upgrade  the  radio  communications  system  to  reduce  radio  interface  and 
communication  difficulties.  When  a  sensor  became  inoperable,  it  was  quite 
often  due  to  the  radio  link  between  the  remote  sensor  and  the  tracker.  The 
problem  was  believed  to  be  in  the  HDLC  interface  or  the  radio  itself.  Addi¬ 
tional  analysis  is  recommended  to  determine  the  cause  of  the  communica¬ 
tions  problem  and  the  recommended  replacement  system. 

(3)  Modify  the  sensor  configuration  to  allow  the  incorporation  of  additional 
sensor  types.  Currently  the  sensor  uses  acoustic  sensors.  Adding  the  capa¬ 
bility  to  place  other  sensors  such  as  seismic,  magnetic,  or  infrared  (IR), 
may  enhance  the  system  capability  and  flexibility  to  expand  application 
possibilities. 

(4)  Conduct  a  set  of  controlled  experiments  using  multiple  targets  with 
ground  truth  to  determine  sensor  and  tracker  performance  as  the  number 
of  targets  increases.  These  tests  should  be  designed  to  determine  optimal 
sensor  configurations  and  target  separation. 

(5)  Routinely  conduct  sensor  characterization  along  with  field  tests.  Metrics 
calculated  in  this  report  allowed  a  better  understanding  of  the  sensors. 
These  data  were  used  to  improve  tracker  performance,  as  well  as  to 
modify  sensor  algorithms. 
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A/D 

analog-to-digital  converter  board 

ARDEC 

Army  Armament  Research,  Development,  and  Engineering  Center 

ARL 

Army  Research  Laboratory 

CECOM 

Army  Communications-Electronics  Command 

CP 

communications  processor 

DAT 

digital  audio  tape 

DSP 

digital  signal  processing 

EPROM 

erasable  programmable  read-only  memory 

FFT 

fast  Fourier  transform 

GPS 

Global  Positioning  System 

HL 

harmonic  line 

HLA 

harmonic  line  association 

HTRI 

IIT  Research  Institute 

LOBs 

lines  of  bearing 

LPR 

low-cost  packet  radio 

MAP 

maximal  a  posteriori 

MHT 

multiple  hypothesis  tracker 

NCPF 

network  control  processing  facility 

PC 

personal  computer 

RAM 

random-access  memory 

RNADS 

Remote-Netted  Acoustic  Detection  System 

RSS 

root  sum  square 

SNR 

signal-to-noise  ratio 

SS&H 

simultaneous  sample  and  hold 

SURAN 

Survivable  Radio  Network 

SVD 

singular  value  decomposition 

SVP 

soimd  velocity  profile 
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